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DATA COMPRE SSION UNIT CONTROL FOR ALIGNMENT 

OF "outpuF^ Ygn^ 

This invention relates to data compression and especially to the compression of 
digital television signals. 

The example will be taken of the well-known MPEG-2 compression scheme. In 
television production, distribution and transmission, there are a variety of operations 
which require to be performed on MPEG-2 transport streams without adversely 
affecting the performance of - for example - downstream MPEG-2 decoders. The 
term "transport stream" is used here to include both single-programme transport 
streams (TS) which comprise elementary streams of - for example - video, audio and 
data, and multi-programme transport streams (MPTS) which comprise two or more 
single-programme transports streams and - optionally - data or other services. 

A frequent requirement is to receive a nationally distributed MPTS and to 
replace one of the programmes with a locally produced programme. Similarly, it is 
frequently required to insert local advertisements or announce programmes. A 
procedure exists for performing these types of operations, but the procedure is 
cumbersome and lacks flexibility. Briefly, the programme to be replaced within the 
nationally distributed SPTS is constructed so as to have within it a number of splice 
points. At these splice points, the group of picture (GOP) stmcture, the video buffering 
verifier delay and certain other parameters are constrained. Specifically, the GOP 
structure will be an*anged so that the last picture (in presentation order) before an out 
point is either a non-predicted i-frame or a fonward only predicted P-frame. The video 
buffering verifier delay (which corresponds with the buffer occupancy in the 
downstream decoder) will take a predefined value. The bitstream which is to be 
inserted at the splice point will then be arranged to start with an I-frame and to have an 
initial value for the video buffering verifier delay which is equal to the same 
predetermined value. This is cumbersome; moreover, it is generally not possible to 
switch the bit-stream at anywhere other than the splice points. 

It is one object of the present invention to provide improved method and 
apparatus which overcomes or ameliorates the difficulties associated with prior art 
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techniques. 

Accordingly, the present invention consists in one aspect in a method of 
controlling a compression unit which outputs a compressed bit-stream, the method 
comprising the steps of supplying to a reference input of the compression unit, a 
5 transport stream input with a sequence of transport packets; nominating a set of the 
transport packets as reference packets and arranging for the compression unit to 
output packets in alignment with the reference packets. 

Suitably, the transport stream comprises a multi-programme transport stream 
and wherein the nominated set of transport packets comprises those packets 
'fO associated with a selected programme. The nominated set of transport packets will 
" V typically comprise sub-sets of packets, those sub-sets being associated with respective 
video, audio, data and service information elementary streams of the selected 
programme. 

Advantageously, each compression unit is arranged to output packets having at 
t5 least one parameter determined by the reference packet with which it is in alignment. 
~1 Those parameters may include: a clock reference such as the MPEG-2 Programme 
73 Clock Reference (PGR); the location of video and audio frame starts; time stamps 
such as the MPEG-2 Presentation Time Stamps (PTS) and Decode Time Stamps 
(DTS); and a delay value such as the MPEG-2 Video Buffering Verifier (VBV) delay. 

20 In a different aspect, the present invention consists in a method of replacing a 

programme within a multi-programme transport stream by the output of a programme 
compression unit, comprising the steps of supplying the multi-programme transport 
stream to a reference input of the compression unit, nominating as reference packets 
those packets which are associated with the programme to be replaced; arranging for 

25 the compression unit to output packets in alignment with the reference packets; and re- 
multipiexing the output of a programme compression unit with the remaining packets of 
the multi-programme transport stream. 

In one arrangement according to this invention, there is proposed the use of a 
"reference" MPEG-2 bit-stream input to an MPEG-2 encoder, such that the output of 
30 the encoder is controlled by this "reference" input. This input is in addition to and in 
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parallel with the other customary inputs to an encoder. 

The "reference" MPEG-2 bit-stream input could be regarded as the MPEG-2 
equivalent of the "genlock" synchronisation input common on equipment handling 
uncompressed video. The latter input is used to force the equipment's output to 
5 conform with the timing of one particular video signal, whereas the "reference" 

MPEG-2 bit-stream input is used to force the output of the MPEG-2 encoder to 
conform with timing and/or other aspects of one particular programme within the 
multiplex carried by a particular MPEG-2 transport stream signal. 

This capability is potentially useful in all multi-programme applications of MPEG-2 
^^0 - for example - where MPEG-2 encoders and decoders are cascaded; where 

individual MPEG-2 programmes are to be added, substituted or othenA/ise combined 
tfi together, or where a non-MPEG-2 programme is to be added, substituted or othenA/ise 

combined with programmes within an MPEG-2 transport stream. 

For example, if one programme is to be substituted for another within a mutti- 
d5 programme MPEG-2 transport stream which has already been encoded (i.e. it is from 
J "upstream" of the switch system) whilst it is "on-air", MPEG-2 decoders "downstream" 
% of the switch system are very likely to produce noticeable artefacts unless the following 
^ critical timing-related MPEG-2 parameters are consistent before and after the switch: 

• Access Unit (AU) timing, 

20 • Programme Clock References (PCRs), 

• Decode Time-Stamps (DTSs), 

• Presentation Time-Stamps (PTSs), and 

• Video Buffering Verifier delay ("vbv_delay"). 

An MPEG-2 encoder can make these critical parameters consistent with 
25 another MPEG-2 programme from "upstream" if that MPEG-2 encoder has a 
"reference" MPEG-2 bit-stream input. 

As a second example, it may be beneficial to make the Elementary Stream (ES) 
bit-rates within a programme being encoded dependent on the bit-rates of one or more 
other programmes from "upstream". Applications which would benefit from this include 
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various forms of statistical multiplexing and the substitution of one programme for 
another within a multi-programme MPEG-2 transport stream, without the use of a full 
(scheduling) MPEG-2 remultiplexer and even where the multi-programme MPEG-2 
transport stream has a fully-occupied payload capacity. An MPEG-2 encoder can 
5 make the ES bit-rates consistent with another MPEG-2 programme if it has a 
"reference" MPEG-2 bit-stream input. 

The only external "references" on conventional MPEG-2 encoders are external 
clock signals from which ES bit-rates and/or total programme bit-rate can be derived. 
This allows bit-rates to be set with high accuracy, which would allow one MPEG-2 
J O encoder to have bit-rates very close to those of another MPEG-2 encoder. 

::l The "reference" MPEG-2 bit-stream input according to one aspect of this invention 
■ 5 allows bit-rates to be matched exactly with those from "upstream" encoders. It also 
allows other MPEG-2 parameters to be matched. It is the exactness of the matching 
and the ability to match other parameters (such as PCR's) that make this aspect of the 
=15 invention so powerful. 

P The nature of the compression unit will depend upon the circumstances. If, for 

ji example, a regional opt-out is required, the compression unit will be a full encoder 
receiving the regional programming as live video. If, in another example, locally- 
targeted advertisements or announcements are to be inserted, these may exist on a 

20 server as pre-encoded streams. The compression unit will in that instance be a 
transcoder. 

Conventional statistical multiplexing employs control paths extending from the 
multiplexer to the individual coders, allocating available bit rate to the respective coders 
whilst ensuring that the fixed bit rate for the multiplex is not exceeded. 

25 This invention provides an alternative arrangement which has certain important 

advantages. 

Accordingly, the present invention consists in another aspect in apparatus for 
forming a multi-programme transport stream having a fixed overall bit rate and in which 
the instantaneous allocation of that bit rate amongst the programme transport streams 
30 is controllable, comprising a plurality of programme compression units each having a 
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reference input; a controller which generates a transport stream reference having sets 
of reference packets associated respectively with the respective compression units, in 
which the relative occurrence of packets of the respective sets reflects the desired 
instantaneous allocation of that bit rate amongst the programme transport streams, 
5 each compression unit receiving the transport stream reference and being arranged to 
output packets in alignment with the reference packets associated with that 
compression unit and a multiplexer which combines the outputs of the respective 
programme compression units to from a multi-programme transport stream. 

The reference transport stream which is passed to all compression units can' 
10 usefully be regarded as a protocol for controlling a statistical multiplexing operation. 
p- The outputs of the compression units (which can be encoders or transcoders or a mix 
of these) can then be passed to a conventional but non-statistical multiplexer. This will 
be convenient if - for example - encryption is required to be added in the multiplexer 
-J In simpler arrangements, because the outputs of the respective compression units are 
15 aligned with different sets of reference packets and are thus never coincident, it will be 
possible to combine the streams by a simple OR'ing operation, 

J The invention will now be described by way of example with reference to the 

O accompanying drawings, in which: 

Figure 1 is a block diagram illustrating one embodiment of the present invention 
20 for performing a local opt-out; 

Figures 2 and 3 are block diagrams illustrating processes conducted in the coder 
of Figure 1 ; 

Figure 4 is a block diagram illustrating a further embodiment of the present 
invention for performing a local opt-out; 

25 Figures 5, 6 and 7 are block diagrams illustrating processes conducted in the 

circuitry of Figure 4; and 

Figure 8 is a block diagram illustrating a further embodiment of this invention for 
multiplexing. 

Before describing in detail specific embodiments of the present invention, it will 
30 be helpful to mention briefly a related technology which is particularly useful in 
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combination witii the present invention. 

It is now recognised that problems associated with cascaded encoding and 
decoding processes can be very much reduced (if not eliminated) if a downstream 
encoder has available to it certain of the coding decisions employed by the upstream 
5 encoder. These decisions may be carried in an infonnation bus which typically 

extends from an MPEG-2 decoder to an IVlPEG-2 encoder. The information bus can 
with great advantage be carried within the video signal Itself. For a more detailed 
explanation, reference is directed to EP 0 765 576 and EP 0 913 058. 

Referring now to Figure 1 , there is illustrated apparatus for performing a local 
fJO programme opt-out. Here, one programme (the "local" programme) is substituted for 
! =; another (the "original" programme) within a muiti-programme MPEG-2 transport stream 
broadcast. 

The Incoming multi-programme transport stream is received at terminal 102, 
3 passing through an MPEG delay 104 to a remultiplexer 106. This provides a multi- 
: J 5 programme transport stream output at terminal 1 08. Where no local opt-out is in force, 
% the input multi-programme transport stream (MPTS) passes seamlessly to the output 
1 6, subject only to a delay. 

•'^ A source of local programming is shown at 1 1 0 and this provides the input to a 

compression encoder 112. It will be understood that if the compression encoder 1 12 
20 were of conventional form, any attempt in the remultiplexer to substitute the locally 
encoded programme for one of the programmes in the MPTS, would almost certainly 
produce severe artefacts. If not crashing, in downstream decoders. 

According to the present invention, the encoder 1 12 received as a reference 
input the multi-programme transport stream. This reference input is used - in ways 
25 that will be described - to control the encoder 1 1 2 so that its output can be substituted 
seamlessly for a designated programme in the MPTS. 

Reference is now directed to Figure 2 which illustrates one of the processes 
inside the encoder 1 1 2 utilising the reference transport stream input. Thus a packet 
detector 200 receives the reference transport stream input together with an indication 
30 of which programme in the multi-programme transport stream, is to be replaced and 
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which the packet detector is therefore required to track. The packet detector 200 then 
provides for each of the elementary streams of the tracked programme, an indication 
of the location of the associated packets in the MPTS, 

The encoder 112 includes a video coder 202, an audio coder 204 and a data 
5 coder 206. These coders receive video, audio and data inputs, respectively. The 
encoder further includes a PSl generator 208. 

The video elementary stream will be taken as an example; it will be apparent that 
the remaining elementary streams are treated in analogous fashion. 

The video coder 202 is arranged to provide a packet output when it receives a 
9 0 packet request. The corresponding output from the packet detector 200 will normally 

provide such requests so that the video coder 202 will provide packets which are 

aligned with those packets in the reference transport stream which correspond with the 
: video elementary stream of the tracked programme. To enable the encoder to function 

in the absence of a reference transport stream input, a stand-alone packet request 
,15 generator 210 is provided. This has a clock-timing reference input and a further input 
J: which sets the desired bit-rates for the various elementary streams. The packet 
■ n request generator provides an output for each of the elementary streams and there is a 
- t notional ganged switch arrangement 212 which enables the elementary stream coders 

to be locked either to the incoming reference transport stream or to free run in a stand- 
20 alone mode under control of the stand-alone packet request generator. 

It will thus be seen that "reference" packets in the MPTS (that is to say the 
packets associated with the elementary stream which is to be replaced by the output of 
a specific coder) are provided to the coder to ensure that the packets which are output 
by the coder are in alignment with those reference packets. In the normal case, this 
25 will be a temporal alignment although it will be understood that in certain non-real time 
processes, the alignment will be according to a measure which is related to time. The 
reference packets are used additionally to control certain parameters in those packets 
which are output in alignment with the reference packets. 

Referring to Figure 3, the reference packets which are provided by the packet 
30 detector 200 are passed also to a packet analyser 302, Whilst the packet detector 200 
will provide a reference packet output for each of the elementary streams within the 
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tracked programme, Figure 3 - for clarity of illustration - shows only the video 
elementary stream. 

The packet analyser 302 reads each packet, identifies a number of parameters 
and makes those parameters available to the video coder 202. The packets which are 
5 output by the video coder are then not only in alignment with the reference packets but 
also share certain key parameters. For example, the packet analyser will identify the 
Programme Clock Reference (PGR) in each packet and will provide this to the video 
coder. The analyser 302 will also identify time stamps (both presentation time stamps 
(PTS) and decoder time stamps (DTS) and the video coder 202 will again ensure that 
10 these time stamps are present also in the locally coded packets. The analyser 302 will 
3. also determine the Video Buffering Verifier delay {VDV_delay) and will ensure that this 
value, or related information concerning buffer occupancy, is passed to the video coder 
which uses this information to ensure that there are no discontinuities in buffer 
occupancy. Finally, in this example, the packet analyser 302 is adapted to identify 
^5 frame starts; this information is used in the coder to ensure that there is synchronism in 
the frame starts between the programme to be replaced and the locally encoded 
programme, tf there is an established protocol that a frame start will occur at a 
predetermined point in a packet, this location information will simply be the location of 
the packet containing the frame start. 

20 There will now be described a more detailed embodiment according to the 

present invention. This more detailed embodiment utilises the information bus 
technology, referred to eariier, in which inter-alia, a decoder can make available on an 
information bus, information relating to coding decisions taken in the upstream 
encoding process, 

25 Reference is now directed to Figure 4. A multi-programme transport stream input 

400 is taken to a distribution amplifier 402 which provides the MPTS input through a 
fixed MPEG-2 delay 404 to a remultiplexer 406. This remultiplexer provides a multi- 
programme transport stream output 408 which in the case where there is no local opt- 
out in effect, corresponds to the MPTS input, subject to a fixed delay. The distribution 

30 amplifier 402 also makes the transport stream available to a decoder 410. This is 

arranged to decode the particular programme in the multi-programme transport stream 
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which it is required to replace. Decoding of the programme to be replaced is useful in 
that it enables fades or other digital effects to be provided at the splice points, rather 
than a simple switch from one programme into the next. Thus, the decoded video and 
audio from the decoder 410 are passed to a video and audio mixer 412 which also 
receives the output of the local video and audio source 414. Sync signals are taken 
from the decoder 410 to ensure synchronisation of the local video and audio 

source 414. 

The output from the video and audio mixer 412 passes to the coder 416. As with 
the previous embodiment, this decoder also receives as a reference input the multi- 
programme transport stream input. Additionally, because the decoder 410 is of the 
type an-anged to provide an infomnation bus output, the coder 416 can utilise both the 
transport stream reference input and the information bus to ensure that the packets 
which are output by the coder 41 6 are capable of seamless remuxing in multiplexer 
406 with the remaining packets of the multi-programme transport stream. 

Transport packets are too frequent to be able to convey their timing in the 
information bus, so the "reference" MPEG-2 transport stream input is used for this 
purpose, in the manner previously described. 

Other co-alignment issues for the "local programme opt-out" application are 
described below. These also illustrate the practical use of the "reference" MPEG-2 bit- 
stream input to the local coder 416 in Figure 4. 

Even when using the video information bus technology to extract coding 
decisions, unavoidable rounding variations in the DCT make it impossible to 
guarantee encoding of an elementary stream to exactly the same number of bits as in 
the "upstream" encoder. An arrangement such as Figure 5, uses control logic within 
the coder 416 employed to align locally encoded access unit (AU) headers with 
corresponding AU headers in the reference transport stream. 

Figure 5 is a generalised outline for a non-specific elementary stream. It shows 
the extraction of AU headers and timestamps (DTSs and PTSs) from the "reference" 
input. To allow the "control logic" block to calculate the relative timing of "local" and 
"reference" AUs, AU headers and timestamps are also extracted from the local video 
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input using a form of the information bus technology which has been extended to carry 
timestamps. 

In more detail, the reference transport stream input is taken to a header detection 
and time stamp extraction block 500 which provides an input to a control logic block 
5 502. The corresponding elementary stream of the local programme is encoded at 
block 504, there being an appropriate control feedback from the control logic block 
502. The output of the encoding process passes to a timestamp (PTS and DTS) 
allocation block 506 and to a main buffer 508. A second header detection and 
timestamp extraction unit 510 operates on the buffer output, to provide the second 
,40 input to the control logic 502. Real control of the main buffer is effected by the control 
J-J logic 502. The output of the main buffer passes through a secondary buffer 512 and 
through an access unit length adjustment block 514, both of these blocks being under 
control from the control logic 502. The output of the access unit length adjustment 
; block 514 is then made available to the remultiplexer 406. 

The "access unit length adjustment" function shown is only needed where a 
particular ES has AUs of unpredictable length (so that encoded AUs in the "local" 
programme are not guaranteed to be the same length as in the "original" one). This 
.^^ length adjustment may be performed, for example, by controlling quantisation and by 
inserting ES padding. 

20 The AU co-alignment implementation described above offers a way to 

automatically set the "fine" timing of the "local" data path. This is because after the 
timestamps have been matched up and a local AU header has then arrived before the 
corresponding one from the reference stream, reading from the local video buffer stops 
until an AU header arrives from the reference stream. This has the effect of fine-tuning 

25 the "local path" delay by changing the local main video ES buffer level. 

The AU length adjustment process just described can then be run through once 
after coder power-up to fine-tune the video ES buffer level before attempting any 
seamless switching. 

In addition to the "fine-tuning" just described, the AU co-alignment architecture 
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described above offers a way to set the "coarse" MPEG-2 delay timing during system 
installation. This is done in a special set-up mode ("delay coarse adjust" mode) in 
which all co-alignment is inhibited. Timestamps are extracted in blocks 500 and 510 in 
Figure 5 and sent via the "local CPU" 516 to the overall system controller This can 
5 then subtract the timestamps and set the "MPEG-2 delay" accordingly. This time 
difference extracted from the timestamps sets the MPEG-2 delay tap which feeds the 
coder. The MPEG-2 delay tap which feeds the Seamless Remux can then be set to 
the same value plus a fixed offset for the remaining path delay difference between the 
two Seamless Remux inputs in Figure 5. 

10 The ability to automate system data path delay set-up in this way shows a 

benefit of using the information bus and the "reference" MPEG-2 input together at the 
:0 MPEG-2 encoder. 

4:1 When a switch between bypass and local paths is about to take place, the 

encoded data within every ES representing the same uncompressed content must be 
15 in the same AU in the "local" encoded programme as it is in the "original" one. 

i; For video, co-aligning content requires the arrangement already shown in 

Figure 5. This shows control logic within the local coder time-aligning locally-encoded 

'"^ AUs with corresponding AUs in the "reference" transport stream. This gives complete 
content co-alignment for the video by using its inherent picture boundaries. 

20 Similar methods may be used to co-align audio and data services. 

When a switch between bypass and local paths is about to take place, the 
decoder buffer levels (in decoders downstream of the whole local opt-out system) must 
be the same for each ES between the "local" programme and the "original" one. This 
constrains the PTSs and DTSs within each local ES. 

25 To meet this constraint, the local coder needs an internal "local" PGR which is 

consistent with the values passed through the information bus when they are present, 
and which continues to run, locked to the rate of the "reference" bit-stream PGR, when 
values passed through the information bus are absent (i.e. whilst the system is "opted 
out" to the local programme). This "local" PGR can then be used for to generate both 
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audio and video timestamps. One possible architecture is shown in Figure 6. 

Although the ES encoding chain is separate for each ES, the local PGR offset 
is set using the video ES only. This is because only one ES needs to be used to 
correct the PGR as all ESs must share the same common resulting PGR. Comparing 
5 timestamps within all ESs would also complicate the logic. Video is chosen as the ES 
on which to perform timestamp comparison because it has the best-defined timing 
(using the Video MOLE™}. 

Turning to Figure 6, the reference transport stream input is taken to a PGR 
extraction and reconstruction block 602, the output of which is added at 604 with 
,J0 the output of a latch 606. The output of the add block 604 provides a PGR bus 
^'2 which is made available to the audio elementary streams which take their PGR 

timing from the video stream. Briefly, for each audio elementary an input 608 is 
encoded at 610 and passes through a PTS and DTS allocation block 612 which 
-J receives the PGR bus. The output of block 612 passes through an elementary 
. 15 stream main buffer 614 to the multiplexer 406. The PGR bus is also latched at 

616 in the processing for the video elementary stream. The input at 61 8 passes 
'J to an encode block 504 with extracted information bus, information passing to a 
PTS and DTS extraction unit 620. This provides an output which is interpolated 
for every picture at 622. The interpolated output passes to a multiplexer 623 
20 which wili select the values from the information bus, if these are valid, and pass 
them to the PTS and DTS insertion unit 506. This multiplexer also receives an 
input from the latch 616. The output of the interpolation block 622 also passes to 
a subtracter block 624, for subtraction of the values from the iatch 616, with the 
output being smoothed at 626 and passing as a PGR offset to latch 606. This 
25 latch receives clock and reset signals from the local GPU 517. 

The timestamps values for each picture may be a PTS, a PTS and DTS, or 
neither. If both are present then only DTSs are subtracted (in the subtract block 624 in 
Figure 6) because there is no need to subtract PTSs as well (the difference between 
PTSs should be the same as between DTSs; the choice of DTSs over PTSs here is 
30 arbitrary). 
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In order for the proposed system architecture to work properly, it must be 
possible to subtract video timestamps for any picture, even though PTSs and DTSs 
may an-ive at. different times in the "local" and "original" programmes. The local coder 
always produces timestamps for every picture (within the header of the PES packet 
which it always produces for every picture). Just in case the "upstream" encoder does 
not, the arrangement of Figure 6 interpolates timestamps for every picture from those 
supplied to the local coder in the information bus from the decoder 410. 

PGR and "vbv_delay" values need to be co-aligned to prevent timing "hiccups" 
in downstream decoders when the local opt-out system performs a seamless switch. 

In standalone operation the local coder produces valid "vbv_delay" values 
(which are only ever present within the video ES), and the timestamp co-alignment 
implementation described above co-aligns the PGR values used internally to the local 
coder. However, the "vbv_delay" and PGR values output by the local coder would still 
be incorrect for the following two reasons. 

• The AU co-alignment scheme shown in Figure 5 introduces an ES delay 
in the "secondary buffer". This "padding delay" acts is in addition to the main ES 
buffer delay which would apply in stand-alone operation. The "padding delay" is 
needed as "local path" delay fine-tuning but it invalidates the "vbv_delay" values 
which pass through it. This is because the main video ES buffer, including the 
"padding delay", is a single buffer whose occupancy is used to calculate the local 
"vbvdeiay" values. 

• The arrangement of Figure 5 also adds a variable delay by holding up 
local AU headers during AU length adjustment, which invalidates the PGR values 
which pass through it by adding large amounts of jitter. 

To correct for these effects, "vbv_delay" and PGR values can be re-calcuiated 
from scratch just before the output of the MPC. Figure 7 shows one possible 
implementation of this "re-stamping". 

The reference transport stream input is taken to block 702 where the PGR is 
extracted and a full PGR at 27 MHz resolution is reconstructed. This reconstructed 
PGR then passes through block 704 where a fixed offset is added for the delay from 
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the reference input to the local output. The full PGR Is reduced In block 706 to a non- 
extended format (90 kHz resolution). In block 708 a variable offset Is added to 
compensate for the padding delay added to the main video elementary stream buffer in 
alignment of the packet. This provides a PGR bus which is used as shown generally in 
block 710 for the elementary stream encoders, buffer, timestamp and (optionally) PGR 
insertion. Timestamps are extracted at 712 and in block 714 the PGR value from 
block 706 Is subtracted to provide an output in block 71 8. This receives the output of 
the access unit co-alignment block 716 and re-stamps, that is to say locates and 
replaces the VBV_delay. The output passes to block 720 which receives inputs from 
the block 704 and the local GPU 517 to re-stamp (that is to say locate and replace) 
PGR. The output of block 720 then forms the local path output. 

The "variable offset" to the PGR bus shown in Figure 7 Is the same "offset" as is 
shown in Figure 6. The "timestamp extraction" block shown in Figure 7 is the same one 
used to identify each "local" video AU for AU co-alignment (the lower of the two shaded 
blocks In Figure 5). The timestamp extracted from the video ES is the DTS value (or 
the PTS if there is no DTS) because "vbv_delay" is a time interval before decoding 
rather than before presentation. 

Each of the preceding co-alignment mechanisms Is dependent on extracting 
timing-related information from the "reference" input to the local coder within the local 
opt-out system. Go-alignment of each parameter is vital to guarantee that the "local 
opt-out" can be seamlessly switched in and out, i.e. without artefacts at "downstream" 
decoders. 

In addition, the "reference" input has been shown to allow automatic system 
data path delay equalisation when used in conjunction with the information bus 
technology. 

In the preceding examples, attention has been focussed on the situation in 
which it Is desired to replace one programme in a multi-programme transport 
stream. This is not the only use, however, of a reference transport stream input 
according to the present invention. There are situations, for example, in which it will 
be useful to use a single transport stream reference input to control a compression 
unit, either an encoder or a transcoder. In a more radical departure, it will be useful 



wo 00/22830 



-15- 



PCT/GB99/03361 



in certain cases to employ a reference transport stream input which is not taken 
from a "real" multi-programme transport stream, but is artificially generated, purely 
as a reference. An example will make this clearer. 

It is a common requirement to multiplex a number of single programme 
transport streams with dynamic allocations of bitstreams according to the content or 
priority of the respective single programme transport streams. So-called statistical 
multiplexers are available which have elaborate control links with the single 
programme transport stream encoders to enable the required dynamic allocation of 
bit-rates. In certain circumstances, a programme encoder will be remote from the 
multiplexer with no control loop being feasible. The single programme transport 
stream may, for example, exist in encoded fomi on a file server. In such a case, it 
will be preferable to pass the encoded transport stream through a transcoder rather 
than to decode the transport stream to video in one unit and then to pass the video 
signal to a coder unit which is capable of receiving a control signal from the 
multiplexer. There will be other situations where the requirement to receive a 
specific format of control signal from a statistical multiplexer will represent an 
undesirable constraint. 

Turning now to Figure 8, there is shown an arrangement in which a series of 
transcoders 801 to 810, each receives a single programme transport stream from a 
file server 820. The single programme transport streams from the transcoders are 
multiplexed at 830 to form a multi-programme transport stream. 

A reference transport stream generator 840 generates what might be termed a 
template for the multi-programme transport stream output of the multiplexer 830. 
Within this reference multi-programme transport stream, reference packets will be 
allocated to the specific programmes and the number of packets allocated per unit 
time to a specific programme will effectively set the instantaneous bit-rate output for 
the transcoder for that programme. Since the transcoders which supply the 
multiplexer 830 are all constrained to provide packets in alignment with the 
reference transport stream, it is ensured that the overall desired bit-rate for the multi- 
programme transport stream output (whether fixed or variable) is always complied 
with. Moreover, since the nature of this control does not rely on feedback loops 
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from the multiplexer to a coder, there is no requirement to allow a safety margin in 
the bit-rate allocation to account for control delays and tolerances. This will ensure 
optimal use of the available output bit-rate. The use of a transport stream reference 
has a further advantage that a well-documented and easily reproducible control 
5 input is employed, rather than a proprietary control loop. 

Each transcoder will typically comprise a decoder and an encoder linked using 
information bus technology so as to avoid cascade loss. The encoder stage will 
then employ the reference transport stream input and the information bus signal in a 
manner analogous to that previously described so as to provide a single programme 
1 0 transport stream output which has packets aligned with the nominated packet of the 
reference transport stream input. Moreover, the individual packets of the single 
programme transport stream will taken parameters (such as the PGR and 
timestamps) from the nominated packets of the reference transport stream input. 

The reference transport stream generator 840 may receive information 
15 concerning the SPTS's from the file servers or from the transcoders. It will typically 
also receive extemal control signals. 

-1 One particular example of use of the arrangement of Figure 8 where control of 

the reference transport system generator 840 is especially straightfonward is for 
Near Video on Demand (NVOD). Here the various single programme transport 

20 streams are time-shifted version of each other. 

It will be understood that this invention has been devised by way of examples 
only and a wide variety of further modifications are possible within objects from the 
scope of the invention. 
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CLAIMS 

1 . A method of controlling a compression unit which outputs a compressed bit- 
stream, the method comprising the steps of supplying to a referenco input of the 
compression unit, a transport stream input with a sequence of transport packets; 
nominating a set of the transport packets as reference packets and arranging for 
the compression unit to output packets in alignment with the reference packets. 

2. A method according to Claim 1 , wherein the transport stream comprises a multi- 
programme transport stream and wherein the nominated set of transport packets 
comprises those packets associated with a selected programme. 

3. A method according to Claim 2, wherein the nominated set of transport packets 
comprises sub-sets of packets, those sub-sets being associated with respective 
elementary streams of the selected programme. 

4. A method according to Claim 1 , wherein each compression unit is arranged to 
output packets having at least one parameter determined by the reference packet 
with which it is in alignment. 

5. A method according to Claim 4, wherein said parameter is a clock reference. 

6. A method according to Claim 4, wherein said parameter is the location of a frame 
start. 

7. A method according to Claim 4, wherein said parameter is a time stamp. 

8. A method according to Claim 4, wherein said parameter is a delay value. 

9. A method of replacing a programme within a multi-programme transport stream 
by the output of a programme compression unit, comprising the steps of 
supplying the multi-programme transport stream to a reference input of the 
compression unit, nominating as reference packets those packets which are 
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associated with tlie programme to be replaced; arranging fertile compression 
unit to output packets in alignment with the reference packets; and re- 
multiplexing the output of a programme compression unit with the remaining 
packets of the multi-programme transport stream. 

10. A method according to Claim 9, wherein the programme compression unit 
comprises a compression encoder receiving an uncompressed input. 

11. A method according to Claim 9, wherein the programme compression unit 
comprises a compression transcoder receiving a compressed input. 

12. A method according to Claim 9, wherein each compression unit is arranged to 
output packets having at least one parameter determined by the reference packet 
with which it is in alignment. 

13. A method according to Claim 12, wherein said parameter is a clock reference. 

14. A method according to Claim 12, wherein said parameter is the location of a 
frame start. 

15. A method according to Claim 12, wherein said parameter is a time stamp. 

1 6. A method according to Claim 12, wherein said parameter is a delay value. 

17. Apparatus for replacing a programme within a multi-programme transport stream 
by the output of a programme compression unit, comprising a compression unit 
having a reference input; means for supplying the multi-programme transport 
stream to said reference input and nominating as reference packets those 
packets which are associated with the programme to be replaced; the 
compression unit being arranging to output packets in alignment with the 
reference packets; and a re-multiplexer for re-multiplexing the output of a 
programme compression unit with the multi-programme transport stream. 



wo 00/22830 



- 19- 



PCT/GB99/03361 



1 8. Apparatus according to Claim 1 7, wherein the progrannme compression unit 
comprises a compression encoder receiving an uncompressed input. 

1 9. Apparatus according to Claim 1 7, wherein the programme compression unit 
comprises a compression transcoder receiving a compressed input. 

20. Apparatus according to Claim 1 7, wherein each compression unit is an-anged to 
output packets having at least one parameter determined by the reference packet 
with which it is in alignment. 

21 . Apparatus according to Claim 20, wherein said parameter is a clock reference. 

22. Apparatus according to Claim 20, wherein said parameter is the location of a 
frame start. 

23. Apparatus according to Claim 20, wherein said parameter is a time stamp. 

24. Apparatus according to Claim 20, wherein said parameter is a delay value. 

25. A method of controlling a plurality of compression units which each output a 
compressed bit-stream, the method comprising the steps of supplying to a 
reference input of each of the compression units, a transport stream input with a 
sequence of transport packets; nominating a different set of the transport packets 
as reference packets for each of the respective compression units and arranging 
for each compression unit to output packets in alignment with the reference 
packets nominated for that compression unit. 

26. A method according to Claim 25, wherein some or all of the compression units 
comprise a compression encoder receiving an uncompressed Input. 

27. A method according to Claim 25, wherein some or ail of the compression units 
comprise a compression transcoder receiving a compressed input. 
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28. A method according to Claim 25, wherein the relative occurrences of the different 
sets of packets in the transport stream input are varied to control the relative bit 
rates of the respective compression unit outputs. 

29. A method according to Claim 28, wherein the activity of each compression unit is 
monitored to inform said control of relative bit rates. 

30. A method according to Claim 25, wherein the outputs of the respective 
compression units are combined to form a multi-programme transport stream in 
which the overall bit rate and the instantaneous allocation of that bit rate amongst 
the programme transport streams is defined by said transport stream reference. 

31 . A method according to Claim 30, wherein the outputs of the respective 
compression units are combined by OR'ing. 

32. Apparatus for fonming a multi-programme transport stream having a fixed overall 
bit rate and in which the instantaneous allocation of that bit rate amongst the 
programme transport streams is controllable, comprising a plurality of programme 
compression units each having a reference input; a controiler which generates a 
transport stream reference having sets of reference packets associated 
respectively with the respective compression units, in which the relative 
occun-ence of packets of the respective sets reflects the desired instantaneous 
allocation of that bit rate amongst the programme transport streams, each 
compression unit receiving the transport stream reference and being arranged to 
output packets in alignment with the reference packets associated with that 
compression unit and a multiplexer which combines the outputs of the respective 
programme compression units to from a multi-programme transport stream. 

33. Apparatus according to Claim 32, wherein the programme compression unit 
comprises a compression encoder receiving an uncompressed input. 
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34. Apparatus according to Claim 32, wherein the programme compression unit 
comprises a compression transcoder receiving a compressed input. 



wo 00/22830 



PCT/GB99/03361 



1 / 7 




Figure 1 



Packet 
detector 



Packet analyzer 






Time 


Frame 




PCR Stamps Buffer 


Start 
J , — 





ZOG 



Video input 



Video coder 



7 



Packet output 



Figure 3 



wo 00/22830 



Cf7GB99/0336i 



Select programme 
to track 



Ref. TS 
input 



Packet 
detector 



Video snput 



Audio input 



Video 
coder 



Audio 
coder 



Data input 



Data 
coder 



PSi 
generator 



log 



Video 



Audio 



Data 



PSI 



Packet 
output 



Request 
i 

Packet 
output 



Request 



Packet 
output 



Request 



Packet 
output 



Request 



TS output 



Video 



Audio 



Data 



PSI 



Standalone 
packet 
request 
generator 



Desired btt- 
rates for 
video, audio, 
data and PS! 



LodK to incoming 
"referer^ce" or 
free-run in 
•standalone" mode 



Clock/timing 
reference 



Figure. 2. 



^ & {f - ^ • 

wo 00/22830 PCT/GB99/03361 




1 

Distributic 


m Amplifier 




/ 


Decoder 



40c 



"Original" bits-stream 




Fixed MPEG-2 delay 



Inf ormation Bus 



T 



Video and 
Audio Mixer 



Seamless Remux 



■ ^12 



Video Syncs 




Coder 

— T 



''Local" bit-stream 



4-i4- 



Figure 4 



WO 00/22830 PCT/GB99/03361 

4 / 7 



To overall system 
controller 



Repeated 
for 
each 
ES 



Local 
CPU 



-SI6 



.../" 4<^6 



Reference 
Transport 
Stream 



Iniiibit 




MUX 



Input 



Control 
feed-back 



Read 
control 





' ( 




/ 


Encode 




PTS & DTS 








allocation 



Control logic 
including AU 
offset counter 



Access unit 

length 

adjustment 





Secondary 
buffer 



Main 
buffer 



■SOg 



Figure 5 



wo 00/22830 



5 / 7 



PCT/GB99/03361 



Reference 
Transport 
Stream 



So: 



To overall system 
controller 



Local CPU 



Reset 



PGR extraction 

and 
recoristruction 



Clock 





Add 




Latch 


6'o4- 






< 





PGR 
offset 



606 

PGR Bus (90kHz resolution) 



,6C8 



6IO 



1 



Input 






^ 


Encode 



PTS & DTS 
allocation 



Repeated for each audio ES 



Main 
buffer 



6lZ 



61^ 



.4-06 



Mux 



62LO 



1 



Information Bus 
PTS and DTS 
extraction 



G2£ 



€2.-2. 



1 



Interpolate 
for every 
picture 



Smooth 



Subtract 



Latch for 
PTS and 
DTS values 



Mux: select values 
from Information 
Bus if valid 



62' 



- Input 



Encode 



For video ES only 



PTS & DTS 
insertion 



Main 
buffer 



SO 4- 



so 6 



Figure 6 



wo 00/22830 



PCT/GB99/03361 



Reference 
Transport 
Stream 



To overall system 
controller 



Local 
CPU 



Extraction and 
reconstruction of full 

extended PGR 
(27MHz resolution) 



Inhibit 



Add fixed offset for 
delay from reference 
input to local output 



^704- 



Reduction of 
PGR to non- 
extended 
format (90kHz 
resolution) 



1. 



Subtract PGR value from 
timestamp value 



PGR bus 



Add variable offset for 
"padding delay" added 
to main video ES buffer 
by access unit co- 

aiignment mechanism 



Local 
path 
inputs 



ES encoders, 

buffers, 

timestamp and 

(optionally) 

PGR insertion 
^ 

7i0 



Extract 
times tamps 
from video 



Access 
imit co- 
alignment 



Re-stamp 
(locate and 

replace) 
vbv_delay 



7\z 



716 



Re-stamp 
(locate and 
replace) 
PCRs 



1 

T2.C 



Local 
path 
output 



Figure 7 



7 / 



7 



§2.0 



File server 




r 


File s 


erver 



7 



§20 



File seiver 



go 



Transcoder 



<iQZ 



Transcoder 



£[0 



Transcoder 



Reference Transport 
Stream Generator 



Single 
Programme 
Transport 
Stream 



Multiplexer 



Multi- 
Programme 
Transport 
Stream 



9SC 



7 



Figure 8 



Declaration and Power of Attorney For Patent Application 



As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to 
my name, 

I believe I am the original, first and sola inventor of the subject matter which is 
claimed and for which a patent is sought on the invention entitled DATA 
COMPRESSION UNIT CONTROL FOR ALIGNMENT OF OUTPUT SIGNAL 
(Attorney Docket No. 87806-9024), the specification of which was filed with my 
authority, on October 1 1 , 1999 as Internationa! Application No. PCT/GB99/03361 , 

1 hereby state that I have reviewed and understand the contents of the above 
identified specification, including the claims referred to above. 

Q } acknowledge the duty to disclose to the Patent and Trademark Office ail 

information known to me to be material to patentability as defined in Title 37» Code of 
ffl Federal Regulations, §1,56. 

0^ And I hereby appoint Derek C. Stettner (Reg. No, 37,945 )> Christopher B. 

g Austin (Reg. No. 41 .592) . John C. Bigler (Reg. No. 29,513) . David L De Bruin (Reg. 
^ No. 35,489), Gerald L Fellows (Reg. No. 36.133) , Joseph A. Gemlgnani (Reg, No. 

19.482). Gregory J. Hartwig (Reg. No. 46,761Jt Daniel S, Jones (Reg. No. 42.697) , 
L Richard L. Kaiser (Reg. No. 46,158), Timothy M. Kelley (Reg. No. 34.201 ), Casimir 

y F. Laska (Reg. No. 30J362). Edward R. Lawson Jr. (Reg. No. 41.931). Richard H. 

i Marschall (Reg. No. 39,290), Glenn Wl. Massina (Reg. No. 40,081), Thomas A. Milter 
:f (Reg. No. 36.871), Kevin P. Moran (Reg- No, 37,193), Leon Nigohoslan, Jr. (Reg. 

zl No, 39.791 ). Andrew R. Peret (Reg. No. 41.246) . David R. Price (Reg. No. 31 ,557), 

H Thomas S. Reynolds 11 (Reg, No, 45.262 ), Raye L. Shaffer (Reg. No. P -47,933 ), 

David B. Smith (Reg No. 27,595), Blllie Jean Strandt (Req. No, 36.940 ). Donald W. 
Walk (Reg, No. 29.118). Sheldon L, Wolfe (Reg, No, 43.996 ), Paul F. Donovan (Reg- 
No. 39.962 ). Jill A. Fahrlander (Reg. No. 42.51 8), Grady J. Frenchick (Reg. No. 
29,018), Karen B. King (Reg, No. 41,898) , Teresa J. Welch (Reg. No. 33,049), 
Robert S. Beiser (Reg. No. 28,687), Witold A. Ziamo (Reg. No. 39.S88 ). and each or 
any of them, my attorneys or agents, with full power of substitution and revocation, to 
prosecute this application and to transact all business in the Patent and Trademark 
Office connected therewith. 

ADDRESS ALL COMMUNICATIONS IN OR PERTAINING TO THIS 
APPLICATION TO: 

Derek C. Stettner 
Michael Best & Frfedrtch LLP 
1 00 East Wisc onsi n Avenue 
Milwaukee, Wisconsin 5320 2-^108 



I hereby ^aim foreign priority benefits under Title 35, United States Code, 
§1 19 of the foreign application for patent or Inventor's certrficate listed below and 
have also Identified below any foreign application for patent or inventor's certificate 
having a filing date before that of the application on which priority is claimed: 

Prior Foreign Application 
9822087.4 GB 9 October 1998 

(Number) (Country) (Day/MonthA'ear Filed) 

The undersigned to this Declaration and Power of Attorney hereby authorize 
the U.S, attorneys named herein to accept and follow instmctions from Mathys & 
Squire, 100 Gray's Inn Road, London WC1X SAL United Kingdom as to any actions 
to be taken in the U,S, Patent and Trademark Office regarding this application 
without direct communication between the U.S. attorneys and the undersigned. In 
the event of a change in the person(s) from whom instructions may be taken^ the 
undersigned will so notify the U.S. attorneys, 

I hereby declare that all statements made herein of my own knowledge are 
true and that all statements made on information and belief are believed to be true; 
and further that these statements were made with the knowledge that willful false 
statements and the like so made are punishable by fine or imprisonment, or both, 
under Section 1001 of Title 18 of the United States Code and that such willful false 
statements may Jeopardize the validity of the application or any patent issued 
thereon. 



1 ^C^c^ . Full name of inventor Graham Ward 



Inventor's signature , 
Date: 

Residence: 
Citizenship: 
Post Office Address: 



^8-3 ^ "2,00 ( 

vyottang Surrey, United Kingdom 
British 

14TressiUan Way 

Working, Surrey GU21 3DL United Kingdom 



-2- 



